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1 

METHOD FOR DECODING VARIABLE LENGTH CODES AND 
CORRESPONDING RECEIVER* 

5 BACKGROUND OF THE INVENTION 

The present invention relates to a method for decoding Variable 

Length Codes. 

Usual image resp. video compression standards contain spatial 
resp. spatial and temporal compression. Temporal compression consists in 
10 that only the first image or one image at predefined time intervals is entirely 
encoded, for subsequent images only the difference to the entirely encoded 
image is encoded. Spatial compression usually consists in that the image is 
firstly applied a transform compression technology such as discrete cosine 
transform or wavelets and secondly applied an entropy compression 
15 technology such as Huffmann code, arithmetic code RVLC or U-VLC all 
belonging to the family of Variable Length Codes. The step of entropy 
compression will be the framework for the present invention. 

A Variable Length Code comprises a plurality of codewords which 
are transmitted on a transmission channel to a receiver. At receiver side, the 
20 codeword dictionary is known, and the decoder separate the codewords out 
of the bit stream to recover originally transmitted data. A drawback of this 
usual decoding method is that transmission errors can propagate spatially 
until the decoder detects that it cannot find any codeword matching the 
received sequence and until the next synchronization sequence is found. 
25 Actually, Variable Length Codes decoding method require a 

reliable transmission channel to be efficient. In mobile communication 
networks, bit errors due to non-reliable transmission medium can result in a 
loss of synchronization when decoding codewords. Moreover, due to real 
time constraints, it is not possible to protect the transmitted data with an 
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error correction mechanism (e.g. radio link protocol) which triggers the 
repetition of erroneous data frames. 

Known in the art are decoding methods for Variable Length Codes 
based on the projection of the received sequence on the codeword 
5 dictionary. Such methods are described in following articles: 

- On Variable Length Codes for Iterative Source-Channel Decoding 
R.Bauer, J. Hagenouer, Proceedings of IEEE Data Compression 
Conference, 2001, page{s): 273-282. 

- Iterative Source-Channel Decoding based on a Trellis representation for 
10 Variable Length Codes, R. Bauer, J. Hagenouer, ISIT 2000, june 25-30, 

Sorrento, Italy. 

These methods expfoit the relationship between bits inside the 
codeword. However, the relationship is not strong enough to recover 
efficiently errors at the receiver. Moreover, the decoded sequences may lead 
to not meaningful codeword sequences even if the decoding of each 
codeword taken individually seems correct. 

A particular object of the present invention is to provide an 
improved method for decoding Variable Length Codes especially in 
communication networks having a non-reliable transmission medium. 

Another object of the invention is to provide a receiver for 
performing this method. 

SUMMARY OF THE INVENTION 

These objects, and others that appear below, are achieved by a 
method for decoding Variable Length Codes according to claim 1 and a 
corresponding receiver according to claim 9. 

According to the present invention, the method for decoding 
Variable Length Codes comprises a step of taking into account constraints 
on the type of data which ore encoded additionally to constraints intrinsic fo 
each codeword. 
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In a first preferred embodiment of the present invention, the 
method consists in computing iterotively partial decoded codeword 
sequences by adding at each iteration an additional plausible codeword. 
For each partial decoded codeword sequence, a metric giving an 
5 information on the meaningfulness of a sequence of data of the predefined 
type is computed. Among all partial decoded codeword sequences having 
the same number of bits, only the partial decoded codeword sequence 
which optimize the metric (herein called sun^ivor) is kept for the next 
iteration. 

1 0 Preferably, the metric consists in a Viterbi metric. 

Preferably, a likelihood is computed for each bit of the survivor 
depending on the partial decoded codeword sequences having the same bit 
length as the survivor. This likelihood is used to generate soft outputs at the 
decoder output. 

15 In further preferred embodiments of the present invention, 

properties intrinsic to image or video data are used to check the correctness ' 

of partial decoded codeword sequences. 

The method according to the present invention presents the 

advantage to provide an increased robustness to non-reliable transmission 
20 channel errors without any bit rate increased due to redundancy and 

without changes at the encoding side. 

The method according to the present invention can be used for all 

type of source decoding (hard input / hard output, hard input / soft output, 

soft input / hard output, soft input / soft output). 
25 The method according to the present invention has the advantage 

to present a computation complexity equivalent to other prior art decoding 

algorithms while providing better results in term of erroneous decoded 

codeword sequences. 
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Further advantageous features of the Invention are defined in the 
dependent claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other characteristics and advantages of the invention will appear 

on reading the following description of a preferred embodiment given by 
way of non-limiting illustrations, and from the accompanying drawings, in 
which: 

- Figure la shows an illustration of a first embodiment of the method 
according to the present inventions- 
Figure 1 b details a simplified example of the method according to the 
present invention; 

- Figure 2 shows the hierarchical organization of video bit stream used in 
a second embodiment of the method according to the present invention 
to determine data type specific properties; 

Figure 3 shows a receiver according to the present invention; 

- Figure 4 represents simulation results obtained using the second 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure I d shows an illustration of a first embodiment of the method 

according to the present invention. 

This first embodiment of the method according to the present 
invention consists in iteratively building lists of plausible decoded partial 
codeword sequences and selecting for further processing some of the 
partial decoded codeword sequences according to property intrinsic to the 
predefined type of data. This first embodiment of the method according to 
the present invention comprises following steps. 

Step 1 1 consists in building a list comprising all plausible partial 
decoded codeword sequences comprising one codeword belonging to the 
dictionary and corresponding to the received data bits. The codewords are 
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generated according to usual Variable Length Code decoding algorithms 
(e.g. H261, H263, H26L, H264, JPEG, MPEG ... or the ones cited in the 
paragraph prior art of the present description) upon reception of encoded 
data from the transmission medium. The present invention does not 
5 address the way the different codewords are obtained, it will then be clear 
for persons skilled in the art that any prior art method can be used for this 
purpose. 

Step 1 2 consists in calculating a metric for the different plausible 
partial decoded codeword sequences. The metric should give an indication 

10 on the meaningfulness of the decoded sequence according to properties 
intrinsic to the type of transmitted data. Preferably, the metric is a Viterbi 
metric which associates an Euclidean distance between the received data 
sequence and the transmitted data sequence. The Viterbi metric gives an 
indication on the probability that a data sequence having a predefined bit 

15 length has been emitted, the received data sequence having the same bit 
length being known. It will be clear for those skilled in the art that other 
metrics reflecting the meaningfulness of a data sequence can be used at the 
place of the Viterbi metric without departing from the scope of the present 
invention. 

20 Step 1 3 consists in selecting for further processing among all partial 

decoded codeword sequences having the same number of bits the one 
which optimizes the predefined metric. The selected partial decoded 
codeword sequence will be called "survivor" in the following. 

Step 14 consists in starting the next iteration by adding one 

25 additional codeword to the partial decoded codeword sequences obtained 
at step 13 and repeating steps 12, 13, 14 until a data block having a 
predefined bit length is obtained (step 15). 

Figure lb details the steps listed above for a simplified example. 
For example, the received data sequence is 
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6 

0 10 110 110 0. 

It is assumed that this sequence correspond to one data block of bit 

length equal to 10 bits. 

The dictionary comprises following codewords. 



5 


code #1 : 


0 


1 


0 




code #2: 


1 


1 






code #3: 


0 


0 






code #4: 


0 


1 






code #5: 


0 


1 


1 


10 


code #6: 


0 


1 


1 




code #7: 


1 


0 


0. 



0 



The first list of plausible partial decoded codeword sequences 
comprising only one codeword comprises two entries code #1 and code 
#4. These two codeword have different bit lengths 3 bits resp. 2 bits. No 
1 5 selection is made according to step 12. 

The list of plaussible partial decoded codewords sequences 
comprising two codewords comprises also two entries: 

Code #1 code #2 

Code #4 code #5 

20 Since these two partial decoded codeword sequences have the 

some number of bits (5 bits), a selection of one of these codeword has to be 
performed according preferably to the Viterbi metric. Only the partial 
decoded codeword sequence optimizing the metric will be kept for further 
processing. Assumed the partial decoded codeword sequence optimizing 

25 the metric is the sequence ; code #4 code #5. At next iteration, the list of 
plausible partial decoded codeword sequences comprising three codewords 
comprises three entries 

Code #4 code #5 code #4 
Code #4 code #5 code #5 
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Code #4 code #5 code #6, 

None of these sequences have the same number of bits, no 
selection is performed 

At next iteration, the list of plausible partial decoded codeword 
5 sequences comprising four codewords comprises 
Code #4 code #5 code #4 code #7 
Code #4 code #5 code #5 code #3 

Code #4 code #5 code #6 code #X would be o codeword 
sequence comprising at least 1 1 bits and is as a consequence no more a 

10 plausible sequence (in this example a data block comprises exactly 10 bits). 
No codeword sequence comprising 10 bits can be obtained which starts 
with code #4 code #5 code #6. 

Since partial decoded codeword sequence code #4 code #5 code 
#4 code #7 and partial decoded codeword sequence code #4 code #5 

15 code #5 code #3 comprises the same number of bits, the metric is used to 
select the partial decoded codeword sequence which optimize the viterbi 
metric. Since the bit length of the partial decoded codeword sequence 
equals the bit length of a data block, the decoding of this data block is 
finished. 

20 In a preferred embodiment of the present invention, additional 

partial decoded codeword sequences are kept for further processing at 
each iteration. This presents the advantage to provide a better correct 
decoding rate with on acceptable increase of the processing load. These 
additional partial decoded codeword sequences kept for further processing 

25 are chosen as described below. 

For each survivor of bit length L, an information related to the 
number of pixels coded in this survivor is computed. This information is 
preferably, the sum of the run parameters for each codewords contained in 
the survivor. 
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Then, for all other partial decoded codeword sequences having the 
same bit length as the survivor of bit length L, the information related to the 
number of pixels coded in the partial decoded sequence (e.g. the sum of 
the "run" parameters for the codewords in the partial decoded codeword 
5 sequence) is also computed and noted R. 

All partial decoded codeword sequences having an information 
related to the number of pixels coded in the partial decoded codeword 
sequence lower than R are kept for the next iteration. 

Alternatively, among the partial decoded codeword sequences 
10 having an Identical information related to the number of pixel coded, only 
the partial decoded codeword sequence which optimises a likelihood as 
defined below is kept for further processing. 

Preferably, the method comprises a step 13' of computing a 
likelihood for each bits of the survivors at each iteration. The likelihood is 
15 preferably a function of the metrics computed for the partial decoded 
codeword sequences having the same bit length as the survivor. This 
likelihood is used to generate soft outputs at the decoder output. It will be 
. ""'^^^^t^^d by those skilled in the art that this step is optional especially if 
hard outputs are generated at the decoder output. ' " 
20 The likelihood can preferably be calculated the following way: 

First, a quantity called "marginal" associated to the "survivor" is 
computed for each bit. This quantity takes into account all partial decoded 
codeword sequences which have to be discarded and which have the same 
bit length as the survivor. 
25 marginal (Xi=l)= ^ 

SpeSetof {candidates to be discarded, survivor }a i = 1^''^ ^^"^^ 

marginalp< i=0) = 

Sp 6 Setof {candidates tobediscar ded, survivor }/X i = 1 ^ ''° ^ 
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with : 

- the i-e bit of the sequence to be decoded 

- Sp the plausible partial decoded codeword sequence of the k-e list 
before discarding all the candidates which are not the survivor. 

5 ' Yp the received data sequence corresponding to the sequence . 

By construction, 5^ is created with a sequence from the previous 
iteration list X^^., : 5), and a new added codeword : =SpV^ 
L is the length in bits of and L' is the length in bits of 5), . 
then : 
1 0 B,^^ {Sp /Yp) = oIci- marginal - of - s; (X, ) ♦ P(y„^ I Y^, ) 

Y^i^ is the received sequence corresponding to this codeword. 
V/€[L»+1,Z] 

- if the corresponding bit of is equal \o X^^x with x € {0,l}, then: 
Bi,Xi=x(Sp/Yp)= ^ ^ 

l^old - marginal - of - Sp (Xl' =0)+ old --marginal « of- SpPCL' =1)J^ ; 
15 - if the corresponding bit of is equal \o X^-^x with x e {0,l}, then: - J- 
Bi,Xi=x(Sp/Yp)=0 

At the end of the iteration process, the "marginal" quantity 
associated to the last survivor is the sum of all the discarded complete 
plausible sequence and the former associate "marginal" quantity of the 
20 survivor itself. 

The "marginal" is a quantity which is used to get a "soft-output" at 
the decoder output. 

The " soft-output" is then preferably computed for each bit the 
following way. 
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10 

2 nnarginal(X j = 1) 
P(X| = 1) _ over all the sequences in the list F 

P(X i = 0) " 2 marginal{X ] = 0) 

over ail the sequences in the list F 



2;niarginal{X ; = 1) 

P(Xi = 1) = over oil the sequences in the list F 



£marginal(X i = 1 ) + ImarginaKX j = 0) 

over all the sequences in the list F over all the sequences in the list F 

2;marginal{X | = 0) 

P(Xi = 0) = over all the sequences in the list F 

Zmarginal(X i = 1 ) + Zmarginal(X \ = 0) 

over all the sequences in the list F over oil the sequences in the list F 

In further preferred embodiments of the present Invention Log-'^ 
and "Sub-log" approximations con be used to generate "soft outputs" at the 
decoder output. 

"Sub-log" is an sub-optimum algorithm of this algorithm with the 
approximation logCe" + c*) = mzx(a,b) to be used in Viterbi algorithm. 

"Log-" is another sub-optimum algorithm of this algorithm with the 
approximation in the Viterbi algorithm : 

log(e^ + e*) = max(a,fe) + log(l + e"'""*') 
where log(l + e"'''"*') is given by a table. 

For these two sub-optimum algorithms, multiplication operations 
become addition operations and no exponential function values 
computation have to be performed (if the errors model is AGWN). 

Figure 2 shows the hierarchical organization of video bit stream 
used in a second embodiment of the method according to the present 
invention to determine data type specific properties. For each picture, the 
imoge or video data comprise a picture header 21 followed by groups of 
blocks 22 (GOB), each group of blocks 22 comprises a GOB header 23 
and macro blocks 24 (MB), each MB 24 comprises a MB header 25and 
data blocks 26. A data block 26 contains a predefined number of pixels N. 
(e.g. 64 pixels in the case of the H.263). 



11 

Each codeword generated by the encoding of a data block 26 is 
represented by a triplet (run, level, last) as described in H263 standard or 
by a couple (run, level) together with on End-of-Block indicator as described 
in the H.26L standard. Other prior art encoding mechanism may be used 
5 without departing from the scope of the present invention (e.g. MPEG, 
JPEG, H261, H264,..). The parameter run represents the number of pixels 
encoded in a codeword. 

According to the invention, partial decoded codeword sequences 
representing a data block should verify following property: 

1 0 X ^^^codeword + 1 ^ N 

codewords e partial sequence 

wherein the parameter "run as defined in "run-length" compression 
methods is associated to each codeword. The parameter "run" is related to 
the number of pixels coded in a codeword 

Indeed, a partial decoded codeword sequence for which the above 
15 mentioned sum would be greater than the number of pixel per data block 
would be an erroneous partial decoded codeword sequence. 

This property intrinsic to the type of data can be used alone in that 
a sequence of decoded codeword can be rejected if it does not fulfil the 
property. In this case, another decoding algorithm (e.g. a more efficient 
20 one) should be used to decode the received sequence. 

Alternatively, this property can be used in combination with the 
decoding method proposed in the first embodiment of the present 
invention. In this case, each partial decoded codeword sequence is checked 
against this property and partial decoded codeword sequences which do 
25 not fulfil the property are discarded. This presents the advantage to further 
reduce the processing load in the decoding method according to the first 
embodiment of the present invention. 
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In a further embodiment of the present invention, the field last from 
the triplet (run, level, lost) according to H263 standard, respectively the 
End-of-Block indicator according to H.26L standard are used to define a 
property intrinsic to the type of data. Indeed, the field "last" or "end of 
5 block" is only set to 1 if the corresponding codeword is the last codeword of 
the data block. In ail other cases (i.e. the decoded codeword is not the lost 
of the data block), the field "lasf or "end of block" must be 0. 

This property intrinsic to the type of data can be used alone in that 
a sequence of decoded codeword can be rejected if it does not fulfil the 
10 property. In this case another decoding of the received sequence should be 
performed. 

Alternatively, this property con be used in combination with the 
decoding method proposed in the first embodiment of the present 
invention. In this case, each partial decoded codeword sequence is checked 
1 5 against this property and partial decoded codeword sequence which do not 
fulfil the property are discarded. This presents the advantage to further 
reduce the processing load in the decoding method according to the first 
embodiment of the present invention. 

Preferably the method according to the present invention in its 
20 different embodiment is used for the transmission of image or video data 
over wireless communication network having per se an unreliable 
transmission medium. 

Figure 3 shows a receiver according to the present invention. 

The receiver comprises a decoder 30 for decoding Variable Length 
25 Codes. Decoder 30 comprises a module 31 for decoding Variable Length 
Codes as known in prior art and a module 32 for checking if decoded 
sequences fulfil a predefined property intrinsic to the type of encoded data. 

Module 31 generates codewords according to usual Variable 
Length Code decoding algorithms (e.g. H261, H263, H26L, H264, JPEG, 
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MPEG ...) upon reception of encoded data from the transmission medium. 
Module 31 forward each new decoded codeword to module 32. Module 32 
comprises means 321 for building partial decoded codeword sequences 
comprises at least two decoded codewords, means 322 for checking if the 
5 partial decoded codeword sequences fulfils one or more properties intrinsic 
to the type of data to decode. 

In a preferred embodiment, means 322 checks if the partial 
decoded codeword sequence optimize a metric calculated for data 
sequences having a predefined bit length. This metric is preferably the 
10 Viterbi metric. Means 322 then only keep for further processing the partial 
decoded codeword sequence which optimize the Viterbi metric among the 
partial codeword sequences having the same bit length. 

In another preferred embodiment means 322 checks is the partial 
decoded codeword sequence fulfills following property 

codewords € partial sequence 

In a further preferred embodiment of the present invention means 
322 checks if the partial decoded codeword sequence fulfills following 
property: 

last last codeword of data sequence^ ^ • 

20 The receiver according to the present invention can be a mobile 

terminal. Alternatively, the receiver can be a part of the base station 
subsystem in the case that the encoded data are decoded at the base 
station subsystem. 

Figure 4 represents simulation results obtained using the second 

25 embodiment of the present invention. A set of image blocks from video 
sequences have been used for simulation. This set of image blocks have 
been transmitted over a gaussian (AGWN) channel and have then been 
decoded according to a prior art decoding method (curve 41) and with the 
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method according to the present invention (curve 42). The curves 41, 42 
show the image block error rate (number of image blocks erroneously 
decoded over total number of transmitted image blocks). 

A gain of 1 to 2 dB is obtained with the method according to the 
present invention. 

The above presented simulation results have been obtained when 
considering the "data" field of the video stream. However, the method of 
the present invention can also be applied to other fields of the video stream 
(e.g. header fields, synchronization words, motion vectors ...) which may be 
of fixed length. Indeed fixed length codes used to encode fixed length fields 
may be considered as a subset of variable length codes. 

As a consequence a receiver equipped with a decoder according tb 
the present invention may be used for all fields of the video stream. 
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CLAIMS 

1/ Method for decoding Variable Length Codes used to encode data having a 
predefined type^ preferably image or video data, said encoded data consisting 
5 in a sequence of codewords belonging to a predefined set of codewords, said 
method comprising the steps of: 

- building at least one partial decoded codeword sequence comprising at 
least two decoded codewords; 

- checking if said partial decoded codeword sequence fulfils at least one 
10 property intrinsic to said predefined type of data. 

2/ Method according to claim 1 , wherein said encoded data are transmitted 
over an air interface in a wireless communication network. 

15 3/ Method according to claim 1, wherein partial decoded codeword 
sequences are iteratively obtained (14) by adding at each iteration an 
additional plausible codeword, the number of partial decoded codeword 
sequences at each iteration being equal to the number of additional plausible 
codewords which can be decoded, and wherein the method comprises the 

20 steps of: 
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- computing (12) a metric for each obtained partial decoded codeword 
sequence; said metric giving an information on the meaningfulness of a 
sequence of data of said predefined type having a predefined bit length; 

- said property intrinsic to said predefined type of data consisting in keeping 
5 (13) only the partial decoded codeword sequence of said predefined bit 

length, herein called survivor of bit length L, optimising said metric for the 
next iteration. 

4/ Method according to claim 3, further comprising the steps of: 
10 - determining an information related to the number of pixels coded in said 
survivor of bit length L; 

- keeping at least one additional partial decoded codeword sequence, 
having the same bit length as said survivor of bit length L, for which said 
information related to the number of pixel coded in said partial decoded 

15 sequence is lower than said corresponding information for said survivor of 
bit length L 

5/ Method according to claim 3, further comprising the steps of: 

- computing a likelihood (13') for each bit of said partial decoded codeword 
20 sequence kept for next iteration, herein called survivor, as a function of 

partial decoded codeword sequences having the same bit length as said 
survivor; 

- generating a soft decoding output as a function of said likelihood. 

25 6/ Method according to claim 1 or 3, wherein said data are image or video 
data, said at least one property intrinsic to image or video data consisting in 
checking if for a partial decoded codeword sequence having a bit length 
smaller or equal to the number of pixels per data blocks, noted N, 
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X ^^^codeword + 1 ^ N , 
codewords e partial sequence 

wherein said parameter "run" is related to the number of pixels coded in o 
codeword. 

5 7/ Method according to any of claims 1, 3, or 6, wherein said data are image 
or video data, said at least one property intrinsic to image or video data 
consisting in checking if 

for a partial decoded codeword sequence having a bit length smaller than the 
number of pixels per data blocks, an indicator of the end of block equals 0 
10 and 

for a partial decoded codeword sequence of bit length equal to the number of 
pixels per data blocks, on indicator of the end of block equals 1 . 

8/ Method according to claims 6 or 7, further comprising the step of 
15 discarding said partial decoded codeword sequence if said property is not 
verified. 

9/ Receiver for receiving data encoded with a Variable Length Code/ said 
receiver being characterized in that it comprises: 
20 - means (321) for building at least one partial decoded codeword sequence 

comprising at least two decoded codewords; 
- means (322) for checking if said partial decoded codeword sequence fulfils 

at least one property intrinsic to said predefined type of data. 

25 
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ABSTRACT 

METHOD FOR DECODING VARIABLE LENGTH CODES AND 
CORRESPONDING RECEIVER. 

5 

The present invention relates to a method for decoding Variable 
Length Codes used to encode data having a predefined type, preferably 
image or video data, said encoded data consisting in a sequence of 
10 codev/ords belonging to a predefined set of codewords. 

According to the present invention, the method comprises the steps 

of: 

- building at least one partial decoded codeword sequence comprising at 
least two decoded codewords; 
15 - checking if said partial decoded codeword sequence fulfils at least one 
property intrinsic to said predefined type of data. 



FIG. 1 
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Code#l L=3 bits 
Code#4 L=2 bits 



Code#l code#2 L=5 bits Metric=0,4 
Code#4 code#5 L=5 bits Metric=l,3 
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Code#4 code#5 code#4 L= 


=7 


bits 


Code#4 code#5 code#5 L= 


=8 


bits 


Code#4 code#5 code#6 L= 


=9 


bits 
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^Decoded codeword sequence 
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